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Abstract 

The celebrated and famous Weierstrass approximation theorem char- 
acterizes the set of continuous functions on a compact interval via uni- 
form approximation by algebraic polynomials. This theorem is the first 
significant result in Approximation Theory of one real variable and 
plays a key role in the development of General Approximation Theory. 
Our aim is to investigate some new results relative to such theorem, to 
present a history of the subject, and to introduce some open problems. 
Key words and phrases: Approximation Theory, Weierstrass' the- 
orem, Sobolev spaces, weighted Sobolev spaces, C/-valued polynomials, 
Q- valued smooth functions. 



Resumen 

El celebrado y famoso teorema de aproximacion de Weierstrass ca- 
racteriza al conjunto de las funciones continuas sobre un intervalo com- 
pacto via aproximacion uniforme por polinomios algebraicos. Este teo- 
rema es el primer resultado significativo en Teona de Aproximacion de 
una variable real y juega un rol clave en el desarrollo de la Teona de 
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Aproximacion General. Nuestro proposito es investigar algunos de los 
nuevos resultados relativos a tal teorema, presentar una historia del te- 
nia, e introducir algunos problemas abiertos. 

Palabras y frases clave: Teorfa de Aproximacion, Teorema de Weiers- 
trass, espacios de Sobolev, espacios de Sobolev con peso, polinomios a 
valores en Q, funciones suaves a valores en Q. 



1 Introduction 

In its most general form, we can say that Approximation Theory is dedicated 
to the description of elements in a topological space X, which can be approx- 
imated by elements in a subset A of X, that is to say, Approximation Theory 
allows to characterize the closure of A in A. 

The first significant results of previous type were those of Karl Weierstrass 
(1815-1897), who proved in 1885 (when he was 70 years old) the density of 
algebraic polynomials in the class of continuous real-valued functions on a 
compact interval, and the density of trigonometric polynomials in the class of 
27r-periodic continuous real-valued functions. Such results were -in a sense- 
a counterbalance to Weierstrass' famous example of 1861 on the existence 
of a continuous nowhere differentiable function. The existence of such func- 
tions accentuated the need for analytic rigor in Mathematics, for a further 
understanding of the nature of the set of continuous functions, and substan- 
tially influenced the development of analysis. This example represented for 
some mathematicians a 'lamentable plague' (as Hermite wrote to Stieltjes 
on May 20, 1893, see [3]), so that, we can say the approximation theorems 
were a panacea. While on the one hand the set of continuous functions con- 
tains deficient functions, on the other hand every continuous function can 
be approximated arbitrarily well by the ultimate in smooth functions, the 
polynomials. 

Weierstrass was interested in Complex Function Theory and in the ability 
to represent functions by power series. The result obtained in his paper in 
1885 should be viewed from that perspective, moreover, the title of the paper 
emphasizes such viewpoint (his paper was titled On the possibility of giving 
an analytic representation to an arbitrary function of real variable, see |16|). 
Weierstrass' perception on analytic functions was of functions that could be 
represented by power series. 

The paper of Weierstrass (1885) was reprinted in Weierstrass' Mathema- 
tische Werke (collected works) with some notable additions, for example a 
short 'introduction'. This reprint appeared in 1903 and contains the following 
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statement: 

The main result of this paper, restricted to the one variable case, can be 
summarized as follows: 

Let f £ C(R). Then there exists a sequence fi, f%, . . . of entire functions 
for which 

oo 

/(*) = £/<(*). 

i=l 

for each In addition the convergence of the above sum is uniform on 

every finite interval. 

Notice that there isn't mention of the fact that the /j's may be assumed 
to be polynomials. 

We state the Weierstrass approximation theorem, not as given in his paper, 
but as it is currently stated and understood. 

Theorem 1.1. (K. Weierstrass). 

Given f : [a,b] — > K continuous and an arbitrary e > 0, there exists an 
algebraic polynomial p such that 

\f(x)-p(x)\ <e, Vxe [a, b]. (1.1) 

Over the next twenty-five or so years numerous alternative proofs were 
given to this result by a roster of some the best analysts of the period. Two 
papers of Runge published almost at the same time, gave another proof of the 
theorem, but unfortunately, the theorem was not titled Weierstrass-Runge 
theorem. The impact of the theorem of Weierstrass in the world of the Math- 
ematics was immediate. There were later proofs of famous mathematicians 
such as Picard (1891), Volterra (1897), Lebesgue (1898), Mittag-Leffler (1900), 
Landau (1908), de la Vallee Poussin (1912). The proofs more commonly taken 
at level of undergraduate courses in Mathematics are those of Fejer (1900) and 
Bernstein (1912) (see, for example g], [7], [16] or [20]). 

We only present a limited sampling of the many results that has been 
related with Weierstrass' approximation theorem, which can be found in Ap- 
proximation Theory and others areas. We would like to include all results but 
the length of this paper would not be suffice enough. In addition, we don't 
prove most of the results we quote. We hope, nonetheless, that the readers 
will find something here of interest. 

In regards to the outline of the paper, it is as follows: Section 2 is ded- 
icated to describe some improvements, generalizations and ramifications of 
Weierstrass approximation theorem. Section 3 presents some new results on 
the subject and to introduce some open problems. 
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2 Improvements, generalizations and ramifica- 
tions of Weierstrass approximation theorem 

There are many improvements, generalizations and ramifications of Weier- 
strass approximation theorem. For instance, we could let / be a complex- 
valued, or take values in a real or complex vector space of finite dimension; 
that is easy. We could let / be a function of several real variables; then it is 
also easy to formulate the result. And we could let / be a function of several 
complex variables. That would require a more profound study, with skillful 
adaptations of both hypothesis and conclusion. Finally, of course, we may try 
with functions which take theirs values in an infinite-dimensional space (see 
Section 3 below). 

Among the results of this kind we can find: 

Theorem 2.1. (Bernstein). 
Let f : [0, 1] — ► R bounded, then 

lim B n (f;x) = f(x), 

n — >oo 

for each x e [0,1] where f is continuous. Furthermore, if f S C([0, 1]) then 
B n {f]x) converges to f uniformly. 

Notice that if / S C([a, b]), we can take y = |5f f° r translate the ap- 
proximation problem to interval [0, 1] and to use the Bernstein polynomials 
B„(f;y). 

The theorem of Bernstein besides showing Weierstrass' result, gives a 
bonus: an explicit expression for the polynomial approximants to the function. 

Simultaneously with the study of the approximation for algebraic poly- 
nomials, also the approximation by trigonometrical polynomials was investi- 
gated - beginning with Fourier series-. The problem can generally be outlined: 
Given {fi}i a sequence of a normed space X, when {fi}i is fundamental in 
XI, i.e. when holds that for every g G X and e > 0, exist n and a sequence 
of scalars {cj}j such that 



9-^2 



< e 



This question occupied to many mathematicians during the past century. 
Maybe the oldest and simpler example was proposed by Bernstein in 1912, 
approximately: Let {Xi}^Zi a sequence of distinct positive numbers. When 
the functions 1, x Xl , x X2 , x X3 . . . are fundamental in C([0, 1])? Also, the answer 
was surmised by Bernstein and it is given in the following theorems. 
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Theorem 2.2. (Miintz's first theorem). 

Consider the set of functions {x Al , x^ 2 , . . .} where — g < A,; — > 00. It is 
fundamental in the least-squares norm on [0, 1], if and only if, 52a #0 X" = 00 • 

Theorem 2.3. (Miintz's second theorem, 1914). 

Let { Ai}^ 1 a sequence of distinct positive numbers, such that 1 < \ — > 00. 
Then the set of functions { 1 ^ X ^ 'X * 00 A3 . . .} is fundamental in C ([0,1]), if 
and only if, Y^Li X" = 00 • 

By some time this last theorem was called Miintz-Szasz theorem, because 
Szasz published an independent proof of it in 1916. Seemingly, Bernstein 
solved part of the problem. In fact, taking Xi — i we can recover the Weier- 
strass approximation theorem for [0, 1]. 

Furthermore, the Miintz's second theorem is all the more interesting be- 
cause it traces a logical connection between two apparently unrelated facts: 
the fundamentality of {l 3 . . . } and the divergence of the series of re- 

ciprocal exponents, X^^Li \ - ^ n f ac t, if we wish to delete functions from the 
set while maintaining its fundamentality, this divergence is precisely the prop- 
erty that must be preserved. The reader is referred to [7] for the proofs of the 
both theorems. 

The combination of Dual Spaces Theory and Complex Analysis are very 
usual in the study of fundamental sequences. Another application of these 
techniques is given to solve the problem of Wiener on traslation of fundamental 
sequences, such problem dates from the thirty's decade of the past century and 
is related with the problems of invariant spaces. This problem has generated 
almost so much investigation as Muntz theorem. The following theorem is a 
version of Wiener's theorem. 

Theorem 2.4. (Wiener, approximately 1933). 

Let f <E L 1 (R). For all g G L 1 (R) and every e > there are {c.j}j, C R, 

such that 



(x) -^ Cj f(x - Aj) 



if and only if, the Fourier transform f doesn't have real zeros, that is to say, 

/oo 
e~ itx f{t)dt ^ 0, Vx e R. 
-00 

We shall enunciate two additional theorems on fundamental sequences 
which was published in the 30's of last century and appear in the Russian 
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edition of the book of Akhiezer [2] , and also in the translation of this book to 
German, but not in the translation to English. 

Theorem 2.5. ( Akhiezer- Krein. Fundamental sequences of rational functions 
with simple poles). 

If {aj}^! c C \ [—1,1], is such that aj ^ a^, Vj k, then the sequence 
\ x \ \ * s fundamental in L p ([— 1, 1]), (1 < p < oo) and in C([— 1, 1]), iff 




where the branch of the function f(z) = \fz considered is the usual, is to say, 
yfi > for z E (0, oo). 

Theorem 2.6. (Paley-Wiener, 1934- Trigonometric series non harmonic). 
If {cfj}JLi C C, is such that aj ^ Ok, V j ^ k and < § j j > 1; 

i/ien f/ie sequence {e~~^ m-tx^ joc ^ j s fundamental in L 2 (R) ?j(f 7 

cos(5(gj-)) = 
^ coth(Kfa)) 

where $t(z), 3(z) denote, respectively, the real and imaginary parts of the 
complex number z. 

Other result which despite its recent discovery has already become "classi- 
cal" and should be a part of the background of every student of Mathematics 
is the following. 

Theorem 2.7. (M. H. Stone, approximately 1947). 

Let K be a compact subset of R™ and let C be a collection of continuous 
functions on K to R with the properties: 

i) If f,g belong to C, then sup{/, g} and inf{/, g} belong to C 

ii) If a,b € R and x ^ y € K, then there exists a function f in C such that 
f(x) = a, f(y) = b. 

Then any continuous function on K to R can be uniformly approximated on 
K by functions in C 
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The reader is referred to the paper [28j . in which the original proof of 
Stone appears. 

Another known result, but not very noted, is due to E. Hewitt, |12j . This 
work appeared published in 1947 and it presents certain generalizations of the 
Stone- Weierstrass theorem which are valid in all completely regular spaces. 

There exist another three problems on approximation which have had a 
substantial influence on the analysis of last century: 

1. The problem on polynomial approximation of Bernstein on whole real 
line (between 1912 and 50's). 

2. To characterize the closure of polynomials in families of functions defined 
on compact sets K C C (between 1885 and 50's). It is also necessary to 
mention here the Kakutani-Stone theorem on the closure of a lattice of 
functions real-valued and Stone- Weierstrass theorem on the closure of 
an algebra of functions continuous complex- valued (see [55], [IB])- 

3. The Szego's extremum problem (between 1920 and 40's). 

With respect the first problem, it must be treated for non bounded poly- 
nomials in ±oo. If let us consider a weight w : M. — *■ [0, 1] (i.e. a non-negative, 
measurable function) and we define 

C w '•= { f '■ K — ► continuous with lim (fw)(x) = > , 

I \x\ — >oo J 

with norm 

\\f\\c a := ||/HU°°(R)- 

Bernstein wondered when holds that for all / € C w and every e > 0, there 
exists a polynomial p, such that 

||(/-J>HU-(R) <e? (2.2) 

The condition fw null in ±oo is necessary to give sense to the problem: 
we would like ||£w||l°°(r) < oo, Vp € P, and in particular ||a; n i(;||ioo( R ) < 
oo, Vn > 0. Notice that this condition necessarily makes limuuoo x n w(x) = 
0, then using (|2.2p we would have ||/ty||L°°(R) < e, therefore fw is null in ±oo. 

Among those that contributed to the solution of this problem are Bernstein 
(1912, 1924), T. S. Hall (1939, 1950), Dzrbasjan (1947) and Videnskii (1953). 
In the case w continuous weight the solution solution was given by H. Pollard 
(1953); other solutions were given by Akhiezer (1954), Mergelyan (1956) and 
Carleson (1951). 
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The techniques used in the solution of Bernstein's problem includes Dual 
Spaces Theory, other problems of approximation, Entire Functions Theory, 
analytic on the half-plane and a lot of hard work. 

For the approximation problem on compact subset of the complex plane, 
the situation is as follows: 

Let K a compact set of complex plane, we define 

A(K) := {/ : K — > C, continuous in K and analytic in K } , 
where K° denotes the interior of K and the norm is given by 

11/11 : = II / II L°° (K) ■ 

If we consider 

P(K) := {/ : K — > C, such that there exist polynomials {p n } 
with lim ||/ -p n \\ L °°(K) = 0}, 

n— >oo 

the interesting question is, when P(K) = A(K)1 

May be this problem was never assigned a name, but in spirit it should be 
called the Runge problem (1885), whose fundamental contributions to Ap- 
proximation Theory still can be seen in the course of Complex Analysis. 
Among the interested on the solution of this problem are J. L. Walsh (1926), 
Hartogs-Rosenthal (1931), Lavrentiev (1936) and Keldysh (1945). 

Theorem 2.8. (Mergelyan, 1950's). 

Let K C C compact, the following statements are equivalent: 

1. P{K) = A(K). 

2. C \ K is connected. 

With respect to Szego's extremum problem, it can be expressed as follows: 
Let us consider a non-negative and finite Borel measure /i on the unit circle 
H := {z & C : \z\ = 1} and p > 0. The Szego's extremum problem consists on 
determining the value 

Sp{n) := inf \P(z)\ p dfi(z) : P is a polynomial with P(0) = lj 

{Cj} [ 27r - /l1 f>l J 
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Since every polynomial P(z) of degree < n with P(0) = 1, 



Q(z) := z 1l P Q 

is a monic polynomial of degree n, \Q(z)\ — \P(z)\ whenever \z\ = 1, and we 
have 

Spin) = inf < — / |Q(z)| p dfi(z) : Q is monic polynomial! . 

This problem, has had more impact in Approximation Theory than Bern- 
stein's problem or the Mergelyan theorem. Its solution and the techniques 
developed from it have had a great influence in the Spaces Hardy Theory and 
also on the Functions Theory in the 20th. century. 

Theorem 2.9. (Szego, 1921). 

Let \x absolutely continuous measure with respect to Lebesgue measure on the 
unit circle II, with dfi(z) = w(e l8 )d8. Then 



5 p (fi) = exp I J- / \og(w(e*»))d6 



2ir 

27T 

First Szego showed this result with w a trigonometric polynomial and then 
he used such approximation for extending the result for w continuous function 
and also for general case (see [29 ). The generalization to not necessarily 
absolutely continuous measures came later twenty years and is the merit of 
A. N. Kolmogorov (1941) for p = 2, and M. G. Krein (1945) for p > 0. 

Theorem 2.10. (Kolmogorov-Krein) . 

If fi is a non-negative Borel measure on unit circle II, such that 
dfi(z) = w(z)d9 + djj, s {z), z = e 10 , 

then 

5M = cxp(J-l )^,ru'"u,lH 

So the singular component fi s of (i plays no role at all. 
Corollary 2.1. (Kolmogorov-Krein). 

Given p > and a non-negative Borel measure /! on the unit circle IL, such that 
dfi(z) — w{z)d0 + dfi s (z), z — e %s , the following statements are equivalent: 
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1. The polynomials are dense in L p ([i). 

2. log(w(e i0 ))d8 = -oo. 

Therefore, the polynomials are dense in L p (fj.) only in really exceptional 
cases. In Orthogonal Polynomials Theory, the condition 

/ \og(w(e l8 ))d9 > -oo 
Jo 

is called the Szego's condition. 

In recent years it has arisen a new focus on the generalizations of Wcicr- 
strass approximation theorem, which uses the weighted approximation or ap- 
proximation by weighted polynomials. More precisely, if / is a compact inter- 
val, the approximation problem is studied with the norm L°°(I, w) defined 

by 

ll/IU»(/,u.) : = esssup^jl/OOHa;) , (2.3) 

where w is a weight, i.e. a non-negative measurable function and the conven- 
tion • oo = is used. Notice that (1.1) is not the usual definition of the L°° 
norm in the context of measure theory, although it is the correct definition 
when we work with weights (see e.g. [5] and [TO]). 

Considering weighted norms L°°(w) has been proved to be interesting 
mainly because of two reasons: first, it allows to wider the set of approx- 
imable functions (since the functions in L°°{w) can have singularities where 
the weight tends to zero); and, second, it is possible to find functions which 
approximate f whose qualitative behavior is similar to the one of f at those 
points where the weight tends to infinity. 

In this case, it is easy to see that L°°(I,w) and L°°(I) are isomorphic, 
since the map *f> w : L°°(I, to) — * L°°(I) given by $f w (f) — fw is a linear and 
bijective isometry, and therefore, ^> w is also homeomorphism, or equivalcntly, 
Y C L°°(I,w), i Sf w (Y) = ^ W (Y), where we take each closure with respect to 
the norms L°°(I, w) and L°°(I), in each case. Analogously, for all A C L°°(7), 

4^(3) = tf^(A) and = V w -x. Then using Weierstrass' theorem we 
have, 

*- 1 (P) = *^ 1 (P) = {/el°°(;, w ):/weC(/)}. (2.4) 

Unfortunately, in many applications it is not just the isomorphism type is 
of interest, since the last equality in (|2.4|) doesn't allow to obtain information 
on local behavior of the functions / E L°°(I,w) which can be approximated. 
Furthermore, if / € L°°(I, to), then in general fw is not continuous function, 
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since its continuity depends of the nature of weight w. So, arises the necessary 
research of the family of weights for which have sense the approximation 
problem by continuous functions. The reader can find in [22] and [27] a recent 
and detailed study of such problem. It is precisely in 22J where appears one 
of the most general results known at the present time: 

Theorem 2.11. (125], Theorem 2.1). 
Let w be any weight and 

Hq := {/ G L°°(w) : / is continuous to the right at every point of R + (w), 
f is continuous to the left at every point of R~(w), 
for each a £ S + (w), esslim a .^ Q + \f(x) — f(a)\w(x) = 0, 
for each a £ S~(w), ess linx,,^- |/(x) — /(ffl)| w(x) = 0}. 

Then: 

(a) The closure of C(R) n L°°(w) in L°°(w) is H . 

(b) Ifw£ L^ C (R), then the closure o/C°°(R) n L°°(w) in L°°{w) is also 

(c) Ifswppw is compact and w € L°°(M), then the closure of the space of 
polynomials is Hq as well. 

Another special kind of approximation problems arise when we consider 
simultaneous approximation which includes to derivatives of certain functions; 
this is the case of versions of Weierstrass' theorem in weighted Sobolev spaces. 
In our opinion, very interesting results in such direction appears in [24] . Under 
enough general conditions concerning the vector weight (the so called type 1) 
defined in a bounded interval I, the authors characterize to the closure in 
the weighted Sobolev space W( k <°°\l,w) of the spaces of polynomials, fc- 
differentiable functions in the real line, and infinite differentiable functions in 
the real line, respectively. 

Theorem 2.12. (\2$, Theorem 4. 1). 

Let us consider a vectorial weight w = (wq, . . . ,Wk) of type 1 in a compact 
intervall = [a, b}. Then the closure ofPnW k '°°(I,w), C°°(R) n W k ^(I, w) 
and 

C fe (R) n W k ^° c (I 1 w) inW k '°°(I,w) are, respectively, 
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Hi ■■= {/ e w k ^{i,w) : /« e FnL°°(i,w k ) L °° {I,Wk) } , 

H 2 := {/ G W k '°°{I,w) : / (fe) G C°°(J) n L°°(/, i^"^ } , 
ff 3 := {/ G ^"(/.u;) : /« G C(/)nl»(/, Wt f (/ ''" l) } . 

The reader is referred to [53] for the proof of this theorem. 

3 Hilbert-extension of the Weierstrass 
approximation theorem 

Throughout this section, let us consider a real and separable Hilbert space Q, 
a compact interval Jcl, the space U§ (I) of all ^/-valued essentially bounded 
functions, a weakly measurable function w : I — > G, the space P(<?) of all Q- 
valued polynomials and the space Ug (J, u>) of all ^/-valued functions which 
are bounded whit respect to the norm defined by 

:=esssup te J(/iu)(t)||g, (3.5) 

where fw : I — ► Q is defined as follows: If dimC? < oo, we have the func- 
tions / and w can be expressed as / = (fx , . . . , f no ) and w = (wi w no ) , 
respectively, where u>j : I — > R, for j = 1, . . . , no, with no = dimC/. Then 

(/to)(t) := (f 1 {t)w 1 (t),...J no {t)w no {t)), forte/. 
If dim ^ = oo, let {Tj}j<=z + be a complete orthonormal system, then 

oo 

(fw)(t) := X)</(*).^)s M*),?}-)^, for t G J. 

It is known that every Q is a real separable Hilbert space isomorphic either 
to K." for some n G N or to Z 2 (M). And in both cases Q has a structure of 
commutative Banach algebra, with the coordinatewise operations and identity 
in the first case and without identity in the second case (see [H]). We use 
this fact in what follows. 
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3.1 valued functions 

Let Q a real separable Hilbert space. A Q-valued polynomial on / is a function 
<f) : I — ► G, such that 

nGN 

where (£) n gN C has finite support. 

Let ¥(Q) be the space of all ^-valued polynomials on /. It is well known 
that F(Q) is a subalgebra of the space of all continuous ^/-valued functions on 
I. We denote by Lg°(I) the set of all weakly measurable essentially bounded 
functions / : I — > Q. For 1 < p < oo let Lg(I) denote the set of all weakly 
measurable functions f : I —* Q such that 

£\\f(t)\\ P gdt < oo. 
Then L g (I) is a Hilbert space with respect to inner product 
(/.$>£></) = J(f(t),9(t))gdt. 

V(G) is also dense in Lg(I), for 1 < p < oo. More details about these 
spaces can be found in [3D]. 

In [55] the author studies the set of functions Q-valued which can be ap- 
proximated by ^-valued continuous functions in the norm Lg?(/, w), where I 
is a compact interval, Q is a real and separable Hilbert space and w is certain 
^/-valued weakly measurable weight, and using the previous results of |24j the 
author obtains a new extension of Weierstrass' approximation theorem in the 
context of real separable Hilbert spaces. 

3.2 Approximation in Wg'°°(I) 

For dealing with definition of Sobolev space Wg'°°{I). First of all, notice that 
we need a definition of derivative /' of a function / 6 Ug (I) , such definition 
can be introduced by means of the properties of Q and the definition of classical 
Sobolev spaces as follows. 
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Definition 3.1. 

Given Q a real separable Hilbert space and / : / — > Q, we say that a function 
g : I — > ^ is the derivative of / if 



9 



{fi> •••>/«„)> if dim0=n o . 

{/(.}fceN with X^fceN l/fe(*)l 2 < 00 1 ^ ^ is inhnite-dimesional. 



So that, we can define the Sobolev space Wg'°°(I) of the space of all the 
C?-valued essentially bounded functions by 

Wg'°°(I) :={f € Lf{T) : there exists /' in the sense of the Definition 3.1 

and /'€£§?(!)}, 

with norm 

WfWw^(i) '■= ll/IU^co + ll/'IUg?co) 

3.3 Interesting problems 

The following problem in this area arises: 
If we consider the norm 

ll/llw^C/.io) := \\I\\l^(i,w) + ||/'|Uge(I,u,)j 

and we define the weighted Sobolev space of ^-valued functions by means of 
the relation 

( feLf(j,w), 

f G ^g'°°(I: w ) ^ { there exists /' in the sense of the Definition 3.1 
{ and f'zLf (I,w), 

then we can ask 

——W 1 ^(I.w) 

1. What is P(£) ? 

2. Which are the most general conditions on the weight w which allow to 

w 1|0 °(J,t») 

characterize V(Q) ? 

Remark 3.1. Some pieces of information are taken from Internet-based re- 
sources without the URL's. 
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